10 research outputs found

    Comparative study of upsampling methods for super-resolution in remote sensing

    Get PDF
    Many remote sensing applications require high spatial resolution images, but the elevated cost of these images makes some studies unfeasible. Single-image super-resolution algorithms can improve the spatial resolution of a lowresolution image by recovering feature details learned from pairs of low-high resolution images. In this work, several configurations of ESRGAN, a state-of-the-art algorithm for image super-resolution, are tested. We make a comparison between several scenarios, with different modes of upsampling and channels involved. The best results are obtained training a model with RGB-IR channels and using progressive upsampling.This work has been partially supported by the ARTEMISAT-2 (CTM2016-77733-R) and MALEGRA TEC2016-75976-R projects, funded by the Spanish AEI, FEDER funds,and by the Spanish Ministerio de Economía y Competitividad, respectively. L.S.R. would like to acknowledge the BECAL (Becas Carlos Antonio López) scholarship for the financial support.Peer ReviewedPostprint (author's final draft

    SEG-ESRGAN: A multi-task network for super-resolution and semantic segmentation of remote sensing images

    Get PDF
    The production of highly accurate land cover maps is one of the primary challenges in remote sensing, which depends on the spatial resolution of the input images. Sometimes, high-resolution imagery is not available or is too expensive to cover large areas or to perform multitemporal analysis. In this context, we propose a multi-task network to take advantage of the freely available Sentinel-2 imagery to produce a super-resolution image, with a scaling factor of 5, and the corresponding high-resolution land cover map. Our proposal, named SEG-ESRGAN, consists of two branches: the super-resolution branch, that produces Sentinel-2 multispectral images at 2 m resolution, and an encoder–decoder architecture for the semantic segmentation branch, that generates the enhanced land cover map. From the super-resolution branch, several skip connections are retrieved and concatenated with features from the different stages of the encoder part of the segmentation branch, promoting the flow of meaningful information to boost the accuracy in the segmentation task. Our model is trained with a multi-loss approach using a novel dataset to train and test the super-resolution stage, which is developed from Sentinel-2 and WorldView-2 image pairs. In addition, we generated a dataset with ground-truth labels for the segmentation task. To assess the super-resolution improvement, the PSNR, SSIM, ERGAS, and SAM metrics were considered, while to measure the classification performance, we used the IoU, confusion matrix and the F1-score. Experimental results demonstrate that the SEG-ESRGAN model outperforms different full segmentation and dual network models (U-Net, DeepLabV3+, HRNet and Dual_DeepLab), allowing the generation of high-resolution land cover maps in challenging scenarios using Sentinel-2 10 m bands.This work was funded by the Spanish Agencia Estatal de Investigación (AEI) under projects ARTEMISAT-2 (CTM 2016-77733-R), PID2020-117142GB-I00 and PID2020-116907RB-I00 (MCIN/AEI call 10.13039/501100011033). L.S. would like to acknowledge the BECAL (Becas Carlos Antonio López) scholarship for the financial support.Peer ReviewedPostprint (published version

    Single-image super-resolution of sentinel-2 low resolution bands with residual dense convolutional neural networks

    Get PDF
    Sentinel-2 satellites have become one of the main resources for Earth observation images because they are free of charge, have a great spatial coverage and high temporal revisit. Sentinel-2 senses the same location providing different spatial resolutions as well as generating a multi-spectral image with 13 bands of 10, 20, and 60 m/pixel. In this work, we propose a single-image super-resolution model based on convolutional neural networks that enhances the low-resolution bands (20 m and 60 m) to reach the maximal resolution sensed (10 m) at the same time, whereas other approaches provide two independent models for each group of LR bands. Our proposed model, named Sen2-RDSR, is made up of Residual in Residual blocks that produce two final outputs at maximal resolution, one for 20 m/pixel bands and the other for 60 m/pixel bands. The training is done in two stages, first focusing on 20 m bands and then on the 60 m bands. Experimental results using six quality metrics (RMSE, SRE, SAM, PSNR, SSIM, ERGAS) show that our model has superior performance compared to other state-of-the-art approaches, and it is very effective and suitable as a preliminary step for land and coastal applications, as studies involving pixel-based classification for Land-Use-Land-Cover or the generation of vegetation indices.This work was funded by the Spanish Agencia Estatal de Investigación (AEI) under projects ARTEMISAT-2 (CTM2016-77733-R) and PID2020-117142GB-I00 of the call MCIN/AEI/10.13039/501100011033).Peer ReviewedPostprint (published version

    A dual network for super-resolution and semantic segmentation of sentinel-2 imagery

    Get PDF
    There is a growing interest in the development of automated data processing workflows that provide reliable, high spatial resolution land cover maps. However, high-resolution remote sensing images are not always affordable. Taking into account the free availability of Sentinel-2 satellite data, in this work we propose a deep learning model to generate high-resolution segmentation maps from low-resolution inputs in a multi-task approach. Our proposal is a dual-network model with two branches: the Single Image Super-Resolution branch, that reconstructs a high-resolution version of the input image, and the Semantic Segmentation Super-Resolution branch, that predicts a high-resolution segmentation map with a scaling factor of 2. We performed several experiments to find the best architecture, training and testing on a subset of the S2GLC 2017 dataset. We based our model on the DeepLabV3+ architecture, enhancing the model and achieving an improvement of 5% on IoU and almost 10% on the recall score. Furthermore, our qualitative results demonstrate the effectiveness and usefulness of the proposed approach.This work has been supported by the Spanish Research Agency (AEI) under project PID2020-117142GB-I00 of the call MCIN/AEI/10.13039/501100011033. L.S. would like to acknowledge the BECAL (Becas Carlos Antonio López) scholarship for the financial support.Peer ReviewedPostprint (published version

    Weakly supervised semantic segmentation for remote sensing hyperspectral imaging

    No full text
    This paper studies the problem of training a semantic segmentation neural network with weak annotations, in order to be applied in aerial vegetation images from Teide National Park. It proposes a Deep Seeded Region Growing system which consists on training a semantic segmentation network from a set of seeds generated by a Support Vector Machine. A region growing algorithm module is applied to the seeds to progressively increase the pixel-level supervision. The proposed method performs better than an SVM, which is one of the most popular segmentation tools in remote sensing image applications.Peer Reviewe

    Super-resolution of Sensinel-2 imagery using generative adversarial networks

    Get PDF
    Sentinel-2 satellites provide multi-spectral optical remote sensing images with four bands at 10 m of spatial resolution. These images, due to the open data distribution policy, are becoming an important resource for several applications. However, for small scale studies, the spatial detail of these images might not be sufficient. On the other hand, WorldView commercial satellites offer multi-spectral images with a very high spatial resolution, typically less than 2 m, but their use can be impractical for large areas or multi-temporal analysis due to their high cost. To exploit the free availability of Sentinel imagery, it is worth considering deep learning techniques for single-image super-resolution tasks, allowing the spatial enhancement of low-resolution (LR) images by recovering high-frequency details to produce high-resolution (HR) super-resolved images. In this work, we implement and train a model based on the Enhanced Super-Resolution Generative Adversarial Network (ESRGAN) with pairs of WorldView-Sentinel images to generate a super-resolved multispectral Sentinel-2 output with a scaling factor of 5. Our model, named RS-ESRGAN, removes the upsampling layers of the network to make it feasible to train with co-registered remote sensing images. Results obtained outperform state-of-the-art models using standard metrics like PSNR, SSIM, ERGAS, SAM and CC. Moreover, qualitative visual analysis shows spatial improvements as well as the preservation of the spectral information, allowing the super-resolved Sentinel-2 imagery to be used in studies requiring very high spatial resolutionThis research has been supported by the ARTEMISAT-2 (CTM2016-77733-R) and MALEGRA (TEC2016-75976-R) projects, funded by the Spanish Agencia Estatal de Investigación (AEI), by the Fondo Europeo de Desarrollo Regional (FEDER) and the Spanish Ministerio de Economía y Competitividad, respectively. L.S. would like to acknowledge the BECAL (Becas Carlos Antonio López) scholarship for the financial support.Peer ReviewedPostprint (published version

    Clinical manifestations of intermediate allele carriers in Huntington disease

    No full text
    Objective: There is controversy about the clinical consequences of intermediate alleles (IAs) in Huntington disease (HD). The main objective of this study was to establish the clinical manifestations of IA carriers for a prospective, international, European HD registry. Methods: We assessed a cohort of participants at risk with <36 CAG repeats of the huntingtin (HTT) gene. Outcome measures were the Unified Huntington's Disease Rating Scale (UHDRS) motor, cognitive, and behavior domains, Total Functional Capacity (TFC), and quality of life (Short Form-36 [SF-36]). This cohort was subdivided into IA carriers (27-35 CAG) and controls (<27 CAG) and younger vs older participants. IA carriers and controls were compared for sociodemographic, environmental, and outcome measures. We used regression analysis to estimate the association of age and CAG repeats on the UHDRS scores. Results: Of 12,190 participants, 657 (5.38%) with <36 CAG repeats were identified: 76 IA carriers (11.56%) and 581 controls (88.44%). After correcting for multiple comparisons, at baseline, we found no significant differences between IA carriers and controls for total UHDRS motor, SF-36, behavioral, cognitive, or TFC scores. However, older participants with IAs had higher chorea scores compared to controls (p 0.001). Linear regression analysis showed that aging was the most contributing factor to increased UHDRS motor scores (p 0.002). On the other hand, 1-year follow-up data analysis showed IA carriers had greater cognitive decline compared to controls (p 0.002). Conclusions: Although aging worsened the UHDRS scores independently of the genetic status, IAs might confer a late-onset abnormal motor and cognitive phenotype. These results might have important implications for genetic counseling. ClinicalTrials.gov identifier: NCT01590589

    Cognitive decline in Huntington's disease expansion gene carriers

    No full text

    Clinical and genetic characteristics of late-onset Huntington's disease

    No full text
    Background: The frequency of late-onset Huntington's disease (&gt;59 years) is assumed to be low and the clinical course milder. However, previous literature on late-onset disease is scarce and inconclusive. Objective: Our aim is to study clinical characteristics of late-onset compared to common-onset HD patients in a large cohort of HD patients from the Registry database. Methods: Participants with late- and common-onset (30–50 years)were compared for first clinical symptoms, disease progression, CAG repeat size and family history. Participants with a missing CAG repeat size, a repeat size of ≤35 or a UHDRS motor score of ≤5 were excluded. Results: Of 6007 eligible participants, 687 had late-onset (11.4%) and 3216 (53.5%) common-onset HD. Late-onset (n = 577) had significantly more gait and balance problems as first symptom compared to common-onset (n = 2408) (P &lt;.001). Overall motor and cognitive performance (P &lt;.001) were worse, however only disease motor progression was slower (coefficient, −0.58; SE 0.16; P &lt;.001) compared to the common-onset group. Repeat size was significantly lower in the late-onset (n = 40.8; SD 1.6) compared to common-onset (n = 44.4; SD 2.8) (P &lt;.001). Fewer late-onset patients (n = 451) had a positive family history compared to common-onset (n = 2940) (P &lt;.001). Conclusions: Late-onset patients present more frequently with gait and balance problems as first symptom, and disease progression is not milder compared to common-onset HD patients apart from motor progression. The family history is likely to be negative, which might make diagnosing HD more difficult in this population. However, the balance and gait problems might be helpful in diagnosing HD in elderly patients
    corecore